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Abstract 

We analyze the stationary distribution of regulated Markov mod¬ 
ulated Brownian motions (MMBM) modified so that their evolution 
is slowed down when the process reaches level zero — level zero is 
said to be sticky. To determine the stationary distribution, we extend 
to MMBMs a construction of Brownian motion with sticky bound¬ 
ary, and we follow a Markov-regenerative approach similar to the one 
developed in past years in the context of quasi-birth-and-death pro¬ 
cesses and fluid queues. We also rely on recent work showing that 
Markov-modulated Brownian motions may be analyzed as limits of a 
parametrized family of fluid queues. We use our results to revisit the 
stationary distribution of the well-known regulated MMBM. 

Keywords: Fluid queues, regenerative processes, Markov-modulated Brown¬ 
ian motion, sticky boundary. 

1 Introduction 

Systems in real life are designed with feedback loops: a buffer in a telecom¬ 
munication network is not allowed to repeatedly overflow without its input 
being throttled, water conservation measures are taken before reservoirs get 
thoroughly dry, and so on. This is our reason for being interested in stochastic 
processes with reactive boundaries, that is, processes that change behaviour 
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upon hitting some boundary. In the present paper, we focus on regulated 
Markov modulated Brownian motions (regulated MMBMs for short), with a 
sticky boundary at level 0. 

An MMBM is a two-dimensional process {X(t),(p(t) : t > 0} with 
X(-) G R and <£>(•) G Xi = {1,... ,m} with m < oo. The component {<£>(£)} 
is a continuous-time Markov chain and controls as follows the evolution of 


W)}: 



d<S + 



Here, /i t and cr i; for 2 G Ad, are real numbers with cq > 0, and {W{t)} is a 
standard Brownian motion independent of {</?(£)}. We call (p{t) the phase at 
time t and X(t) the level. 

The process {Z(t),<p(t)} regulated at zero is 


Z(t) = X(t) + | inf X(s)|. 


( 1 ) 


We assume that the MMBM is drifting to — oo, so that {Z(t),(p(t)} has a 
stationary distribution; this is made more precise in Section 3 and we refer 
to Asmussen [1], Rogers [18] for a general presentation of basic properties. If 
<Ji = 0 for all i, {Z(t), <p{t)} is a fluid queue, a family of processes extensively 
analyzed by Ramaswami [16], da Silva Soares and Latouche [7] and Bean et 
al. [3], among others. 

Brownian motions with a sticky boundary were introduced by Feller [8] 
in the 1950s. Briefly stated, the regulated Brownian motion is slowed down 
when it is at level 0, in such a way that, without actually staying at zero for 
any interval of time of positive length, it does spend in that level an amount 
of time with positive Lebesgue measure. 

The construction in Harrison and Lemoine [10] works as follows: one 
starts with a Brownian motion {A"*(t) : t > 0} with parameters /i and a 2 , 
define its regulator R*(t) = | inf 0 < s <t X*(s)| and define the regulated process 
as Z*(t) = X*{t)+R*(t). Next, one defines the functions V*(t) = t+R*(t)/ui, 
where cu > 0 is some fixed constant, and T*(£) such that R*(T*(£)) = t. 
Finally, one defines 

Y*(t) = Z*(T*(t)). (2) 

We refer to T* as the new clock. The process {H*(£)} is a Brownian motion 
with sticky boundary, with parameters /i, a 2 , and oj. The time change in (2) 
modifies each trajectory of Z* by increasing the time spent in state 0, while 
leaving to behave exactly like {Z*(t)} away from zero. 

We extend in two ways this construction to Markov modulated Brownian 
motion. First, we define in Section 4 a straightforward generalization based 
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on the regulator R(t). Taking the phase into account, we decompose R(t) as 
the sum of m sub-regulators 

ri(t) = j l{y?(s) = i} dR(s) (3) 

Jo 

for i E A4 and all t. It is clear that ?y(t) increases only when Z(t) = 0 and 
( p{t ) = i , and that R{t) = 7y(£). Next, we dehne 

V(t) = t+y^ / r i (t)/uj i (4) 

ieM 

where 0 Ji > 0, and we dehne the function T(f) such that V (T(£)) = t. Observe 
that through the dehnition (4) of V(t), we allow the clock T(t) to slow down 
at different rates for different phases. Our new process is {Y(t),<p(t)} with 
Y{t) = Z(T(t)), (p[t) = <p(T(t)). In Section 7 we investigate another process, 
such that the marginal distribution of the phase is allowed to change as a 
result of the process hitting the boundary. 

To determine the stationary distribution of our processes, we follow a 
Markov-regenerative approach. We choose points of regeneration forming a 
subset of the epochs when the process hits level 0: let {A n ,n > 0} denote 
a sequence of i.i.d. random variables exponentially distributed with param¬ 
eter q. We dehne 

0 n +i = hifjt > 9 n + A n+ i : Y(t) = 0}, (5) 

for n > 0, with 9o = 0. In short, once the process hits the boundary, we start 
an exponential timer and we do not register the instantaneous returns to 0 
by the Brownian motion; at the expiration of the timer, one is again able to 
register the next hit at zero. The process {c p n } embedded at the regeneration 
epochs, with tp n = (p(6 n ), for n > 1, is an irreducible discrete-time Markov 
chain with stationary distribution p. 

We also dehne 

fOn+l 

Mij(x) = E[ / l{r(s) G [0,x],<£(s) = j}ds\ip n = i] 

J On 

independently of n; that is, Mij(x) is the expected sojourn time of {h"(f), (p(t)} 
in [0,x] x {j} during an inter-regeneration interval, given that the phase 
is i at the beginning of the interval. The components of m, defined as 
m = M(oo)l, are the conditional expected lengths of intervals between re¬ 
generation points, given the phase at the last regeneration: its ith component 
is rrii = E[9 n+ i -9 n \<p n = i\. Finally, with 

Gi(x) = lim P[Y(t) < x,<p(t) = i], 

£—>•00 
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( 6 ) 


and G(x) = [Gi(x) ... G m (x)], we have 

G(x) = (pm)" 1 pM(x ) 

(see (jinlar [5, Section 10.7]). With our choice (5) for the regeneration points, 
p and M are necessarily functions of the parameter q, while the function 
G is independent of q\ as we show in Theorem 5.3, the expression in the 
right-hand side of (6) is indeed independent of q. We note that any set of 
regeneration points will do, provided that they lead to a discrete-time Markov 
chain and that one is able to determine the expected sojourn times between 
regenerations. 

We rely on results obtained in Latouche and Nguyen [13, 14] to determine 
p and M. We defined in [14] a family of fast oscillating fluid queues and we 
showed that MMBMs arise as limits of such fluid queues as the speed of 
oscillation increases to infinity. We give in Section 3 the basic definition 
of the approximating fluid queues as well as some properties that we shall 
be using throughout the paper. Before that, we show in Section 2 how to 
construct a family of fast oscillating fluid queues that converge to a Brownian 
motion with sticky boundary. 

We determine in Section 4 the stationary distribution of our first family 
of Markov modulated processes with sticky boundary. In Section 5, we ap¬ 
ply our regenerative approach to the well-known regulated MMBM with one 
boundary and obtain a new form for its stationary distribution; this is dis¬ 
cussed in Section 6, where we analyze the physical meaning of our result and 
compare it to other expressions available from the literature. In Section 7, 
we define and analyze our second model for MMBMs with sticky boundary, 
and we give some brief concluding remarks in Section 8. 

Notation We represent by 1 a column vector of Is and by 0 a vector of Os. 
We generally use the notation X for unregulated processes, Z for processes 
with one boundary, and Y for processes with a sticky boundary. Also, a bar 
over a symbol, as in (p, indicates the phase process of the sticky version. 


2 Sticky Brownian motion 

As indicated in the introduction, we proceed in a manner similar to Harrison 
and Lemoine [10]. In this section, {X(t)} denotes a Brownian motion with 
parameters p < 0 and a 2 > 0, and the regulated process is Z(t) = X(t)+R(t), 
where R(t) = | inf 0 < s <t W(s)|. Our objective is to create a process that 
behaves exactly like Z when it is strictly positive but spends more time at 0. 
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To do this, one defines the function V(t) = t + R(t)/u, where cu > 0, and the 
function T(i) such that V(T(i)) = t. Finally, one defines 


Y(t) = Z(T(t)). 

The process {Y (i)} is a sticky Brownian motion with parameters /i, a 2 and oj. 

The process R(t) is non-negative, non-decreasing and continuous, and 
remains constant when Z(t) > 0. Therefore, V(t) is strictly increasing and 
continuous, and T(i) is well-defined, continuous and strictly increasing. The 
purpose of F(f) is to serve as a new clock, which increases at the same rate 
as t when Z(t) > 0, and at a slower rate when Z(t) = 0, that is, when R(t) 
is increasing. The stationary distribution of Y is 


lim P[Y(t) < x\ 

t—¥ OO 


M 

H + W 


+ 


u 


+ c 0 


(1 


3 2 Iix/o 


(7) 


([10, p. 221]), notice that it has a mass at zero. 

As an approximation to {X(t)}, we define a family of two-state fluid 
queues {X A (f), indexed by A. The generator of the phase process 

]> A (f)} is 

rp _ A A 

[ A -A 

and the fluid rates are C\ — n + cr\/A and C 2 = /i — ay/\. It is shown 
in Ramaswami [16] that {AT A (f)} converges weakly to {AT(f)} as A tends 
to oo. We use the term flip-flop processes to characterize {X A (t)} and other 
fluid queues to be defined in later sections, as a shorthand reminder of their 
behavior: the fluid queue switches steadily faster, as A increases, between 
two increasing fluid rates. We use the regulator R\(t) = | inf 0 < s <t X A (s)| and 
the regulated process Z\{t) = X\(t) + R\(t) to define a two-state flip-flop 
fluid queue {Y A (i)} with a sticky boundary at zero. 

The total time spent by Z\{t) at level 0 is 


£“(<)= f 1{Za(s) = 0}ds. 

Jo 

It is a sum of individual intervals, each of which is exponentially distributed 
with parameter A. To define the process (Yx(t)}, we change the behaviour 
of the phase when the level is 0, and we assume that the intervals of time 
spent there are now exponentially distributed with parameter aV A instead 
of A, for some a > 0. Equivalently, the intervals of time spent at level 0 are 
stretched by a factor \f\ja . The function that defines the new time is 


V x (t) = t 


im+w) 


Vx 
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Clearly, L° x (t) = R\(t)/(a\f\ - p), so that 



( 8 ) 


Finally, the new clock is given by the function T x (t) such that V\(r x (t)) = t, 
and the fluid queue with sticky boundary is {Y x (t),R x (t)}, with Y x (t) = 
Zx(Tx(t)) and R x (t) = K X (V x (t)). 

Theorem 2.1 The processes {Yx(£)} weakly converge to the sticky Brownian 
motion {T(t)} with parameters /i, a 2 and u = aa. 

Proof To simplify our presentation, we rewrite (8) as Vx(t) — t + R x (t)a x - 
We also rewrite the equation V^(r^(f)) — t as 


r A (t) + R x (T x (t))a x = t. 


(9) 


We know by [14, Corollary 3.3] that {Zx(t)} weakly converges to {Z(t)} as 
A —* oo, and so {-Ra(^)} weakly converges to {R(t)}. In addition, the coef¬ 
ficient of R\(t) in (8) converges to l/(acr). Therefore, the hnite-dimensional 
distribution of (Ta(^)} converges to the hnite-dimensional distribution of the 
Brownian motion {Y'(f)} with a sticky boundary and parameters /i, er 2 and 
c o = acr, and we need only to prove tightness. 

By Billingsley [4, Theorem 7.3] we need to prove that the processes are 
tight at time 0, which is obvious since they are all equal to zero, and that 
for all e, r), there exist <5* > 0 and A* such that 


P[ sup | Y x (t) - T A (s)| >e\<r] 


|s—1|<<5 


for all A > A* and 5 < 5*. Now, assume temporarily that s < t. We have 


by (9) 


r A (t) - r A (s) =t-s- (R x (T x (t)) - R x (Tx(s)))ax 

< t — s, 


since both R x and Ta are non-decreasing functions and cza > 0 for sufficiently 
large A. The reverse inequality holds if s > t and so |T a( t) — Ta(s)| < \t — s| 
for all s, t. Therefore, 


sup \Y x {t)-Y x {s)\= sup |Z A (r A (t)) - Z A (r A (s))| 



< sup \Z x (t) — Z x {s)\ 


|s—1|<5 
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and 


P[ sup | Y x (t) - Ya(s)| > e] < P[ sup | Z x (t) - Z x (s)\ > e]. 

|s—1|<5 \s— t|<<5 

This completes the proof since we know by Ramaswami [17, Theorem 5] and 
Whitt [19, Corollary 7] that {Z x (t)} is tight. □ 


Remark 2.2 It is necessary that the transition rate of n x at level zero should 
grow like \/A. To see this, let us assume that we use some general function 
/(A) instead of ay/ A. The stretching factor is A//(A) and (8) becomes 


V x (t)=t + L° x (t)( 

— t + R x (t )- 

— t + R x (t)- 


X 


/(A) 

A- 


- 1 ) 

/(A) 


ay/X- fi)f( A) 
1-/(A)/A 


(cr - n/ v / A)/(A)/ y/\ 


If /( X)/Vx -+ 0 as A —y oo, then V x {t) > oo for all t such that R x (t) > 0, 
and the limit of (Y^(t)} is 0 for all t. On the contrary, if /(A)/a/A —y oo , 
then V x (t) —$■ t, Y x {t) —> Z(t ), and the limiting process is just the original 
regulated Brownian motion. 


3 Preliminaries 


We assume in the sequel that {<£>(£)} is an irreducible Markov process with 
generator Q and we make the following two assumptions. 

Assumption 3.1 The variances <Ji are strictly positive for all i in M.. 


This assumption allows us to significantly simplify our presentation. 

Assumption 3.2 The stationary drift ap is strictly negative, where p = 
[/i i ... /i m ] and ol is the stationary probability vector of {<p(t)}, that is, 

olQ = 0, ckI = 1. 


The inequality cup < 0 is the necessary and sufficient condition for our 
regulated MMBMs to have a stationary probability distribution. 

We shall use the same approach as in [14] and start our analysis from a 
parametrized family of approximating fluid queues driven by a two-dimensional 
phase process {n x (t), p\(t)} on the state space {1,2} x A4, with generator 


Q 


* _ 

A — 


Q-XI 
XI 


XI 

Q-XI 


( 10 ) 
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and fluid rate matrix 


C*(A) 


D + V A0 

D-yJ A0 ’ 


where D = diag(/i],..., /i m ) and 0 = diag(<7i,..., a m ). Next, we define 

Jo 

and Za(^) = X\(t) + | inf 0 < s < t Xa(s)|. For A large enough, the rates /Xj + 
(Tj\/A corresponding to /y\ = 1 are all positive, and the rates /ij — cq\/A 
corresponding to = 2 are all negative. It is shown in [14] that the processes 
{Z\(t), weakly converge to the MMBM {Z(t), tp(t)} as A —> oo. In 

this paper, the phase process will define the evolution of our 

regulated processes whenever the fluid level is strictly positive. Different rules 
will apply at level 0 for different processes, and will be separately detailed in 
each case. 

We use the same definition (5) for the regeneration points of all processes 
{Z\(t), K\(t), <px (£)} and we omit to indicate that the 9 n s depend on A, so as 
not to clutter the notation unduly. A key quantity for the analysis of fluid 
queues is the matrix of first return probabilities to level 0, starting from level 
0 in a phase with strictly positive fluid rate. Because different processes have 
different behaviors at level 0 but the same behavior away from the boundary, 
it will be useful to use the sequence {r n } of first instants when the fluid starts 
increasing away from level 0 after a regeneration epoch: 


T n = inf{t > d n : Kx(t) = 1}, 


for n > 0. During an interval (r„, 9 n+ 1 ), we need to know at any given time 
whether the current timer has expired or not. For that reason, we add a third 
phase component, named with xa = 1 if the timer has not expired yet, 
and xa = 2 otherwise. The two-dimensional phase always evolves 

according to the transition matrix (10) and the transitions of (k\, xx, tpx) are 
controlled, during an interval {r n ,9 n+ 1 ), by the matrix 


T{ A) 


' Q-XI-ql ql 

XI 

Q - XI 

XI 

XI 

Q - XI -ql ql 

XI 

I 

Q> 


( 11 ) 


At regeneration times, the new component %a instantaneously switches from 
Xx(0n) = 2 to Xa(^) = 1, where Xa(^) = lim^ X\(t) and Xa(^) = 








lirrit^n X\(t)- The diagonal matrix of fluid rates is 


C{ A) 


I 2 <E> { D + 0\/X) 

i 2 ®{d- eVx) 


where /2 is the identity matrix of order 2, and we partition the state space 
into the subsets 


S+ — {(1) Xa, <£a) : Xa ^ {1, 2}, (fix £ M } 


and 

S- = {(2, Xa, <fix) ■ Xa e {1,2 },^ a e M}. 
We similarly partition the matrix T(A) as 


T{ A) 


T ++ (A) T + _(A) 
T + (A) T_(A) 


and we write 0+ = J 2 <g) (-D + ©a/A) and C_ — I 2 ® (D — ©a/A). 

The matrix of first return probabilities, indexed by <S + x S_, is denoted 
as Ta and defined by 

(T x)k,i-,k',j = p [£ < oo>Xa(0 = k',(px(0 = j 

|Z A (0) = 0, k a (0) = 1, Xa(0) = k, if X (0) = i] (12) 

where £ = inf{t > 0 : Z\(t) = 0} is the first return time to level 0. It is 
well known (Rogers [18]) that Ta is the minimal non-negative solution of the 
Riccati equation 

C'" 1 T + _(A) + C~ l T ++ { X)X + X\C. | _1 T__(A) + X\C_\~ l T_ + (X)X = 0. 


One easily verifies that it has the structure 

rT A (<?) v c x(q) 
A [ 0 

where 


Ta (q) is the probability matrix of returning to the original level before 
the exponential timer expires, it is the minimal non-negative solution 
of 


AGD+VA0)- 1 + (D + y/\Q)-\Q -XI- qI)X 

+ X\D - A/A0| -1 (g -XI- ql) + XX\D - Vxqi^x = 0, 
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• Ta = 'I'a(O) is the return probability matrix without any time con¬ 
straint, and 

• is the probability of returning to the original level after the ex¬ 
ponential timer has expired, so that 

^ x (q) = ^ x -^ x (q). (13) 

At level 0, we need two transition matrices. The first matrix has entries 

(Pa, ok = P [r n > 9 n + A n+i , y x (9 n + A n+ i) = j\y x (9 n ) = i ], (14) 

for i, j in A4: these are the probabilities that the process continuously re¬ 
mains at level 0 until the expiration of the exponential timer, at which time 
( p x = j, given the phase at time 9 n is i. We need not specify the other phase 
component as k x {9 n + A n+1 ) = 2. The second matrix is 

= P [r n <9 n + A n+ i ,(p x {T n ) = j\<p x {9 n ) = %], (15) 

for i, j in A4: the exponential timer has not yet gone off at time r n , the 
component k x switches from 2 to 1 and the component Xx remains equal 
to 1. 

The phase transition matrix at regenerative epochs is <1 >a, with 

($A )ij = P[(p X (9 n+ l) =j\<p X {9n ) = A- 

Again, we do not need to specify the remaining components of the phases: 
n x (9 n ) = 2 since the fluid rate is negative at that time and Xx(9f) = 1 since 
a new timer interval begins immediately after the regeneration. 

Lemma 3.3 The transition matrix at the regeneration epochs is given by 

$a = /-(/- P x ^ x {q))-\I - P A , o - Pa,i*a), (16) 

Its stationary probability vector p x is 

Px = c ”x{I - P\,i^x{q)) ( 17 ) 

for some scalar c, where v x is such that 

^a(Pa,o + Pa,i^a) = t /\, ^a1 = 1. (18) 
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Proof The transition matrix satisfies the following equation, 

= P\,o + P\,i^l(q) + Px,i^\(q)$\- (19) 

Indeed, at time 6 n the process is at level 0 and either it does not leave level 0 
before the timer expires (this corresponds to the first term), or it does leave 
level zero and returns after the timer has expired (this is the second term) or 
it leaves level 0 and returns before the timer has expired, in which case we 
still have to wait for the next regeneration point (this gives the third term). 

Now, starting from level 0 and any phase in S + , there is a strictly positive 
probability that the process returns to level 0 after the timer has expired. 
Thus, T A (g) 1 > 0 or equivalently, T A (g)l < 1, so that PyiT^g) is a strictly 
sub-stochastic matrix and I — Px.i'&x(q) is non-singular. Thus, (19) becomes 

<h A = (/ - P x ^x(q))-\Px ,o + Px,iV c x (q)) 

by (13). We may rewrite the last equation as 

$A = (/ - Px.iVxiqTHPx.o + Px, l(*A - ^A(<?))) 

and (16) is proved. 

The stationary probability vector p x is such that a = Px- or 

p x (I - Px,^x(q))-\I ~ Px,o ~ Px, i* a) = 0 , (20) 

which proves (17) as soon as we show that iz A exists and is unique. 

By Assumption 3.2, the return time to level 0 is finite a.s., so that T A 1 = 1 
for all A and P Aj o + P A . i V I ; A is an irreducible stochastic matrix, with a unique 
stationary probability vector i/ A . This concludes the proof. □ 

Remark 3.4 It is obvious that the stationary distribution of the phase at 
epochs of regeneration depends, through the transition matrices P A 0 and 
P A .i, on the rules of evolution of the phase when the fluid is at level 0. In 
order to avoid confusion, we use in the sequel the notation p x and its limit p 
for the process associated with the MMBM with sticky boundary, p* x (with 
limit p*) for the flip-flop process analyzed in Section 5 and associated with 
the traditional MMBM, and p for the process analysed in Section 7, with 
sticky boundary and resampling of the phase at level 0. 

4 MMBM with sticky boundary 

As explained in the introduction, we start from the function V(t) defined 
in (4), which is monotone and continuous. We use it to define the new clock 
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r such that V(r(i)) = t, and to dehne the new process {Y(t),<p(t)} such 
that Y(t) = Z(T(t)) and (p{t) = </?(T(t)). 

We call this process a Markov-modulated Brownian motion with sticky 
boundary, with parameters /i, er, co and Q. To obtain its stationary distri¬ 
bution, we proceed in three steps: we construct a family of approximating 
fluid queues, then we determine the stationary distribution p at epochs of 
regeneration, and finally we obtain the matrix M(x) of expected time spent 
in [0, x] during regeneration intervals. 

We decompose the regulator R\{t) = | inf 0 < s < t W A (s)| of the flip-flop fluid 
queue into its sub-regulators 


r\,i(t)=f l{<^ A (s) = i}d.R A (s), (21) 

Jo 

and we write Z\ as the sum Z\ = X\ + Y2i r \i- The total time spent by the 
process in phase i during the interval (0,f) is U\,i(t) = /,{ l{^(s) = i}ds, for 
i G M. 

We repeat for every phase the argument in Section 2: the time spent by 
{Z\(t)} at level 0 in phase i is r\ ti (t)/\pi — cr iA /A| and the functions that 
redehne time are 


V x>i (t) 


U\,i(t) - rx,i(t ) 




1 |^1 A+|(5ii| 

- -j= + r \ ,i(t)- -j= - -j= - 

\pi (T^v A| |Pi 07i v A| d{\ \ T |Qa 

A — ciiV A 

((TiVX pi)( K di'\/-\ T |i5n|) 


for i in A4. For A large enough, their sum is 


V x (t) = t + y~V A[i (t) 

i 


\ + Q{V\) 

a,iai\ + 0(V A) 


and converges to V(t) dehned in (4) with oji = aj<7j. In matrix notation, we 
may write 

V(t)=t + r(t)A~ 1 &- 1 1, (22) 

where A = diag(cq,... a m ) and Y > 0 for all i. With the function V\(t), 
we define the new clock T A such that V A (T A (f)) = t, and the new pro¬ 
cesses (Z A (r A (t)), K A (r A (t)), <^ A (r A (t))). By [14, Theorem 2.7], (Z A (t), <^ A (t)} 
weakly converge to {Z(t), tp(t )} and, by the continuity property of T(i), it is 
clear that the finite-dimensional distribution of (Z A (T A (t)), <^ A (T A (i))} con¬ 
verge to the finite-dimensional distribution of { Y(t),<p(t)}. 

The process (Z A (T A (t)), fc A (T A (i)), </? A (T A (£))} is not very convenient, how¬ 
ever, as its definition does not conform to the usual parametrization of 
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fluid queues. For that reason, we define another fluid queue, denoted as 
{YaO), This new process and {Z A (T A (t)), « A (r A (f)), </? A (T A (t))} 

are not pathwise identical but they have the same distribution. 

The two-dimensional phase (k a , (p\) is controlled by the generator Q* x 
defined in (10) as long as Y\ is strictly positive. When Y\ = 0, the transition 
rates are given by the new matrix 

Qx, o = [VWL {1/V\ )A{Q - A/)] . (23) 

This means that while the process is in level 0, 

• if ip\ = i and K\ = 2, intervals of time are stretched by a factor \/A/a,, 

• there may be a change to <p\ = j with the new rate Qij = diQij/V A 
without changing K\, 

• or the process may change to K\ — 1 at the rate aj\/A, and leave the 
level 0, without changing ip\. 

We denote by p x the stationary distribution of (p\ at epochs of regeneration 
and by M\(x) the matrix of conditional expected time spent by the fluid 
queue in [0,x]. 

Lemma 4.1 The stationary distribution p x converges, as A —^ oo, to the 
vector p such that 

p^qA- 1 - QU(q))- l QU = 0, pl = 1. (24) 

where U(q) is the unique solution of 

i e 2 X 2 + DX + (Q-qI) = 0 (25) 

with eigenvalues of negative real parts, and where U = 17(0). Both U and 
U(q) are generators. For q > 0, all eigenvalues ofU(q) have strictly negative 
real parts; for q = 0, one eigenvalue ofU is equal to 0, the others have strictly 
negative real parts. 

Furthermore, 

p(qA~ l — 017(g)) -1 = c\ v (26) 

for some scalar c\, where 

uQU = 0, ul = 1. (27) 
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Proof The matrix T A defined in (12) does not depend on the behaviour 
of the fluid queue at level 0, so that Lemma 3.3 applies and the stationary 
probability vector p x of <p\(t) is given by (17). 

The matrix P X)0 defined in (14) is given here by 


poo 

P xo = / q e - qu e A{Q ~ XI)u/Vx du 

Jo 

= q(V\A + ql - {l/V^AQY 1 

= 7t qA ~ 1{, + 7t qA ~ l - L A QA - lr ' 

= PqA~ 1 +0(l/X) 

and similarly 

pOO 

P x ,i = e- qu e MQ - XI)u/VX V\Adu 
Jo 

= V\(V\A + ql- (1 /•/\)AQ)~ 1 A 

= / - W/.4 + 0( 1/A) 


(28) 


(29) 


We repeat the proof of [14, Lemma 3.4], replacing Q by Q — g/, and obtain 
that 

y x (q) = I + -LoU(q) + 0(l/\) (30) 

for q > 0, where 77(g) is as stated in the lemma. Altogether, the transition 
matrix is 


*A =[/-(/ - -PqA- 1 )(/ + -j=OU(q))]-‘ 

@ = 1 + (qA- 1 - OU(q))~ 1 OU + 0( 1/y/X), 


U(q))] + 0( 1/A) 


(31) 


which converges to the stochastic matrix 

$ = / + (qA- 1 - QU (g)) _1 ©77 


as A —> oo. The matrices <f> and are irreducible and so the stationary 
probability vector p x of $a converges to the stationary probability vector p 
of <3>, from which (24) follows. 

The remainder of the proof is immediate — observe that (27) is mean¬ 
ingful as U is an irreducible generator. □ 
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Remark 4.2 The matrix 17(g) defined in Lemma 4.1 has the following phys¬ 
ical interpretation: define t x = inf{t : X(t) > x}. we have 

{ e U{q)x )ij = P [t x < E q , <p(t x ) = j\<p(0) = i] 

where E q is an exponentially distributed random variable with parameter q. 
In other words, U(q) is the generator of the Markov process {<p(t x )} if the 
MMBM is killed at the exponential time E q . Equation (25) is a particular 
case of [11, Eqn (2.2)]. 

Lemma 4.3 The expected time spent by the process {Y x (t),<p x (t)} in the 
closed interval [0,x] between regeneration points converges, as A —>• oo, to 

M(x) = ( qA -1 - 017(g)) -1 (A -1 + 2(-K)~\l - e^ x )0 -1 ) (32) 

for x > 0, where 

K = 0P0 -1 + 2 0 -2 P>. (33) 

The expected inter-regeneration interval is 

m = (qA- 1 - 017(g)) -1 (A -1 + 2(-i7) -1 0- 1 )l. (34) 

Proof We denote by M\(x) the expected time spent by the fluid queue in 
[0,x] and we examine M\(0) first. After a regeneration, the process remains 
at level 0 either until the timer expires, or until R\ switches from 2 to 1. 
If the timer expires first, the sojourn time at 0 is over, otherwise, the fluid 
begins to grow and we wait for the level to return to 0. If the return to 0 
happens after the timer has expired, the sojourn time at 0 is over, otherwise 
an additional interval at 0 begins. Thus, 

M x ( 0) = (TaA + ql- (1/VA )AQ)- 1 + P AJ T A (g)M A (0) 

= (/ - P Aa T A (g)) -1 (yA7l + ql- (l/v^AQ) -1 

= - 0 ^)) + 0(l/A)) -1 (-^4 -1 + 0(1/A)) 

by (29, 30). This converges to (gA _1 — 017(g)) -1 7l -1 as A —> oo. 

For x > 0, we have by a similar decomposition 

M x (x) = {y/XA + ql- {1/VX)AQ)~ 1 + P Xtl M f (x) + P x ,^ x (q)M x (x), (35) 

where Mf(x ) is the matrix of expected time spent in the semi-open interval 
(0, x\ until the next return to 0, irrespective of the timer being off or not at 
the time of return. We rewrite (35) as 

M x (x) = (/ - P Ail T A (g)) -1 ((y/XA + ql- (1 /V\)AQY l + P x ,iM f (x)) 

= M x ( 0) + (/ - P A>1 T A (g)) -1 P A , 1 M / (x). (36) 
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By (29, 30), we have 


(/ - iv^g))- 1 ^,! = V\((—U (<?)) -1 © -1 + o(i/7a) 

and by [14, Lemma 3.6] and [12, Theorem 3.7], 

M f (x ) = ~^=(—K)~ l (I - e Kx )Q~ 1 + 0(1/A) 
v A 

where K is given by (33). Altogether, this shows that the limit of M\(x) is 
given by (32). The proof of (34) is immediate. □ 

We collect Lemmas 4.1 and 4.3 in the theorem below and obtain two for¬ 
mally different expressions for the stationary distribution of the MMBM with 
sticky boundary. The first one directly follows from our regenerative process 
approach, the second is independent of the parameter q. In particular, one 
may verify that (38) is identical to (7) when there is only one phase. 

Theorem 4.4 The stationary probability distribution function of the MMBM 
with sticky boundary at zero is given by 

G(x) = i P p{qA~ l - QU{q))-\A- 1 + 2 {-K)-\I - e^)©" 1 ), (37) 

where p is the solution of the system ( 24 ) and y p = 2 (pm) -1 is the normal¬ 
ization constant. 

The distribution is also given by 

G{x ) = lv v{A~ x + 2(—K)~~ 1 (I - e^)©- 1 ), (38) 

independently of q, where v is the solution of the system (27) and = 
(i/(A -1 + 2(—0/1 ) -1 )l) -1 is the normalizing constant. □ 

Proof The process {LA^), ^(f), ^a(^)} has the same distribution as the pro¬ 
cess {Z A (r A (f)),KA(rA(f)),<M r A(h))}- By [14, Theorem 2.7], {Z x (t), ip\(t)} 
weakly converges to {Z(t),(p(t)} and so, by the continuity and convergence 
properties of T(f), we find that the finite-dimensional distributions of {Yx(f), 
converge to the finite-dimensional distribution of {Y(t), 

Furthermore, the family {Y\(t), <P\(t)} is tight. To see this, we adapt the 
proof of [14, Theorem 2.6] and use Lemma 3.3. 

Finally, we adapt the proof of [13, Theorem 3.1] to conclude that the sta¬ 
tionary distribution of (F A (t), <f\(t)} converge to the stationary distribution 
of {Y(t), (p(t )}. Together with Lemmas 4.1 and 4.3, this completes the proof. 

□ 
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The presence of the factor A^ 1 in the expression for M( 0) is easy to 
understand: the greater cq, the faster the process leaves level 0 and the 
smaller the mass at zero for phase i. The marginal distribution of the phase is 
no longer equal to a, as we show in corollary 4.5 below; its proof is immediate 
and is omitted. 


Corollary 4.5 The marginal distribution of the phase is 

G { oo) = 7 MA- 1 + 2(—©AT 1 )- 


□ 


5 Markov-regenerative MMBM 

We revisit here the standard MMBM {Z(t),(p(t)} defined in (1) and fol¬ 
low our regenerative process approach to determine its stationary distribu¬ 
tion. Although expressions are known already for the stationary distribution 
(Rogers [18], Asmussen [1], Latouche and Nguyen [14]), this new analysis is 
of independent interest because it is one of the first to analyze the MMBM 
as a regenerative process. Harrison [9, Chapter 5, Section 4] does treat the 
regulated Brownian motion with two boundaries as a regenerative process, 
but we take a different path. 

We follow the same steps as in Section 4 and, to avoid confusion with 
the results there, we use the mark in the present section. Thus, p* x and 
M x (x) represent, respectively, the stationary distribution of the phase at 
regeneration epochs, and the expected time in [0,x] between regenerations, 
for the flip-flop process {Z\(t), K\(t), <P\(t)} with generator (10). 

Lemma 5.1 As A — > oo, p* x converges to p* such that 

p*(-U(q))- l U = 0. p*l = l, (39) 

where U(q ) is defined in Lemma f.l. In addition, 

p*(—U(q))~ 1 = c^vQ, (40) 

for some scalar C 2 , where v is characterized by (27). 

Proof We start from Lemma 3.3 and we repeat the argument in the proof 
of Lemma 4.1, the only difference being that the matrices P\_ o and P\\ are 
given here by 

Px, o = q(XI + ql — Q r 1 = 0(1/A), (41) 

P\,i = A(A/ + ql- Q)- 1 =1 + 0(1/X), (42) 
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so that the matrix $ A from (16) is 

<h A = / - U(q)~ 1 U + 0(1/VI) 

and converge to <f> = / — U(q)~ 1 U. The remainder of the proof is straight¬ 
forward. □ 

Our next step is to determine the expected time spent in [0, x] during a 
regeneration interval, and then collect the pieces in Theorem 5.3. 

Lemma 5.2 The expected time spent by the MMBM in level 0 between re¬ 
generation points is 0. The time spent in [0,x] (or equivalently in ( 0 , 0 ;],) 
is 

M*(x) = 2(—U(q))~ 1 Q~ 1 (—K)~ 1 (I — e Kx )Q~ 1 for x > 0. (43) 

The expected length of an interval between regenerations is 

m* = 2(-C/(g))- 1 0- 1 (-ir)- 1 0- 1 l. (44) 

Proof We follow the same steps as in the proof of Lemma 4.3. The expected 
time at level zero is 

Mm = (XI + ql — Q r 1 + P\^\(q)Mf(0) 

= (I-P Xil * x (q))- 1 (\I + qI-Q)- 1 

= ±(-U(q))- 1 e- 1 + 0(l/X) (45) 

and so, lim^oo M A (0) = 0. For strictly positive x, we have 
Mm = M*m + (/ - pmm^PxpMfix) 

instead of (36), and (43) follows after simple manipulations. The proof of 
(44) is immediate. □ 

The next theorem directly follows from Lemmas 5.1 and 5.2 and is given 
without proof. 

Theorem 5.3 The stationary probability distribution function of the regu¬ 
lated MMBM is given by 

G*(x) = 7 ; p*(—U(q))~ 1 Q~ 1 (—K)~ 1 (I - e Kx )®~\ (46) 

where p* is the solution of p*(—U(q))~ 1 U = 0, p* 1 = 1, and 7 * = 2 (p*m*)~ l 
is the normalizing constant. 

It is also given by 

G'(x) = 7 >(-AT‘(/ - e & )0-\ (47) 

independently of q, where v is the solution of the system vQU = 0, ul = 1, 
and 7 * = (i/(—iF)- 1 ©- 1 !)- 1 . □ 
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The vector v> is proportional to the vector defined in [14, Theorem 3.7] 
and so the expression (47) is nearly identical to the one given there. 

6 Observations 

The equations (38, 47) have the advantage over (37, 46) of being independent 
of the artificial parameter q. On the other hand, the vectors p and p* have 
the physical meaning of being the stationary distribution of the phase at 
epochs of regeneration, while the interpretation of v is not as clear, as we 
discuss below. 

We define the set £ — {9 n : n > 0} oi regeneration epochs, and we 
partition it into three disjoint subsets: 

£ 0 {@n • @n @n —1 T ^n T~n—li ^ ^ 1} 

£\ ■ @n @n —1 “t~ ^n T~n— 1; ^ ^ 1} 

£a ~ {@n '■ 9-n > @n -1 + A n j n > !}■ 

If 6 n is in £q or in £\. it means that the fluid is equal to zero when the timer 
expires; in the first case, it has not left level 0 at all between Q n -\ and 6 n , 
in the second case, the fluid has left level 0 and has returned there, possibly 
several times. If 9 n is in £ a , then the fluid is above level 0 when the timer 

expires. To keep the notation simple, we do not indicate that these sets 

depend on A. 

We also define £ + = { 6 +} to be the set of all epochs when the fluid hits 
level 0 from above: starting from 6*g = 0, we define 

T n = inf 0 > 6 n : ¥>a(*) £ 5 + }, 

0+ +1 = inf{t > r+ : Z x (t) = 0}. 

Clearly, £ a C £ + , and £b defined as £^ = £ + \ £ a is the set of all epochs when 
the process returns to 0 from above before the expiration of the timer. 

By definition, p x (as well as p* x ) is the limiting distribution of (p x (t ) as 
t goes to infinity by taking values in £$ U £\ U £ a , while we see from (18) 
that v x is the limiting distribution as t goes to infinity by taking values 
in £ 0 U £ + = £q U £b U £ a . This observation provides us with a physical 
interpretation for (17): we rewrite that equation as 

P X (I ~ = cv x 

and we note that (/ — Pa.i'I'a^)) - 1 is the matrix of expected number of 
returns to level 0 at epochs in £^ between two successive regeneration points. 
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We now focus on the traditional MMBM analyzed in Section 5, and we 
compare u\ and p* x . In this case, £ 0 and £\ vanish as A grows bigger, the 
vector u x becomes more like the stationary distribution of the phase at all 
epochs when the fluid returns to level 0, irrespective of the timer, while p* x 
becomes more like the stationary distribution at the subset of those epochs 
when we have an actual regeneration. In the limit, the interpretation of 
may not be given as such to v due to the instantaneous repeated hits at the 
boundary by the Brownian motion, once it reaches level 0. 

The vectors p* and v are both related to the regulator R(t) of (A"(i)}. 
Recall that R(t) = | info< s <t X(s)| is split into the sub-regulators defined 
in (3). It is shown in Asmussen and Kella [2] that Ti(t)/t converges almost 
surely as t —> oo, and we define 

ti = lim Ti{t)/t. (48) 

£—>•00 

Similarly, the regulator R\(t) = | inf 0 < s < t X A (s)| of the fluid queue is split 
into the sub-regulators rx,i(t) in (21) and we define £\ t i = hm i ^. 00 rA,j(t)/t. 

We proved in [13, 14] the weak convergence of {Z\(t), (p\ (£)} to {Z(t), <p(t)}. 
In consequence, the functions R\(t), t > 0, weakly converge to R(t) and the 
vectors t\ converge to £, as A —* oo. 

The function r X)i (t) increases at the rate |/q — \/~Xa t \ during those intervals 
of time when (Z x (t),ip x (t)) = (0, i), and so 

h,i = (ViV A - ^)(P>D _1 (PA^A*(0))i 

= (cTja/A — pi)(p*m* + 0(1/v r \))- 1 (-^=p*(—U(q))~ 1 0~ 1 + 0(1/A))i 

v A 

= ( p*m*)- 1 (p*(-U(q))~ 1 ) i + 0( 1/VA) 
from which we obtain 

£=(p*m*)- 1 (p*(-U(q))- 1 ) (49) 

= c 3 iz@ (50) 

for some scalar c 3 by (40). This provides us with another expression for the 
stationary distribution of MMBMs. 

Corollary 6.1 The stationary probability distribution function of the MMBM 
is given by 

G*(x) = 2£Q~ 1 (—K)~ 1 (I - e Kx )Q~ l (51) 

where £ is defined in (48). The vector £ is the solution of the linear system 

£U = 0, 2£©“ 1 (—A") -1 ©” 1 ! = 1. (52) 
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Proof Equation (51) is a direct consequence of (46) and of the relation (49) 
between £ and p*. Also, by (50), we find that £U = 0 since uQU = 0 
by (27). Finally, we use the normalizing equation Gr*(oo)l = 1 and the proof 
is complete. □ 

One last representation of the stationary distribution G* establishes a 
direct connection with the stationary distribution ot of the Markov process 
{<£>(£)} with generator Q. 

Corollary 6.2 The stationary probability distribution function of the MMBM 
is given by 

G*{x) = aQ(I-e Kx )e~ 1 (53) 

where ct is the solution of the system ctQ = 0, al = 1. 

Proof Obviously, the marginal distribution of the phase is ot , so that by (47) 

ot = G*{ oo) = 7 >(-if)- 1 0- 1 (54) 

and (47) may be rewritten as (53). □ 

Corollary 6.2 may also be proved by a purely algebraic argument. We 
give it below as it illustrates the intricate interconnection between different 
matrices. We proceed through the sequence of equations 



otQ = 0 



ct(Q 2 U 2 + 2 DU) = 0 

by (25) evaluated at q — 0, 


ctQKQU = 0 

by (33) 


ctQK = C 4 IZ 



for some scalar C 4 by (27). Therefore, (47) becomes 

G*(x) = c 5 aO(I — e Kx )Q~ 1 

for some scalar C 5 , and it is easily seen that C 5 = 1 since G*(oo)l = 1 . 

Remark 6.3 Clearly, the stationary distribution of MMBMs may be ex¬ 
pressed under many different guises, even without counting the ones based 
on the time-reversed process, as in [1, 18]. We find the matrix (/ — e ^)© -1 
in each case, pre-multiplied by vectors which depend on the behavior of the 
process at the boundary. 

The connections (51) with the vector £, and (53) with the vector ot cru¬ 
cially depend on the evolution of the phase being independent of the fluid 
level. Indeed, both £ and ct are defined by the unrestricted MMBM: 
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(a) The vector ot is the stationary marginal distribution of the phase when 
its evolution is governed by the matrix Q and is not modified in any 
way; this is the key to the proof of Corollary 6.2. 

(b) The vector £ is defined in (48) as the rate of increase of the regulator in 
the absence of any barrier. Corollary 6.1 requires that the stationary 
distribution at regenerations be related to £ through (49), which is not 
true of the process analyzed in Section 4 and the one defined in the 
next section. 


7 Resampling the phase 


In Section 4, we slow down the evolution of the process at level 0 and we use 
different factors a, for different phases, but the behavior of the phase is not 
otherwise modified. We go one step further now and allow for more general 
perturbations. In the generator (23) of the fluid queue {Y\(t),R\(t),ip\(t)} 
at level 0, transitions of R,\ from 2 to 1 occur at rates proportional to vX 
while transitions of <p x occur at much smaller rates of order 1 /vX We shall 
now assume that both R\ and (p\ may evolve at rates proportional to -\/X 
We define a new family (Yx(f), K\(t), (£)} of fluid queues with generator 

Q* x given in (10) when Y x > 0, and generator 


Q A,0 


VXA (l/y/X)Q + vX4 


(55) 


when Y\ = 0. That is, simultaneous transitions are possible from (ka,<^a) = 
(2 ,i) to (1 ,j) for i ^ j at the rate \/X4jj. In (23), A is a diagonal matrix, 
A = —A, and Q = AQ. 

Assumption 7.1 We assume that A > 0, A tJ > 0 for i ^ j, An < 0, %, j in 
M., and that A + A is an irreducible generator. The matrix Q is such that 
(1 /y/X)Q + vX A is an irreducible generator for A large enough. 

In consequence, the matrix B defined as B = {—A)~ l A is stochastic 
and irreducible, and we denote its stationary probability vector as (3. The 
assumption that A + A is irreducible is a significant restriction: by contrast, 
A + A = 0 for the transition matrix (23), and B is the identity matrix. We 
make this assumption so as to simplify the presentation of the process and 
to let its major feature stand out. 

The matrix Q plays a minor role since the speed of changes induced 
by (1 /\/X)Q is negligible with respect to vX. Actually, our expression in 
Theorem 7.5 for the limiting stationary distribution does not depend on Q. 
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Because of the additional mixing of the phases allowed by the matrices 
A and A, we have a more complex transformation than the simple change 
of clock in Section 4. Away from 0, {Y\(t),ip\(t)} behaves exactly like 
but at level 0, as A grows bigger, the evolution of the phase 
is controlled mostly through the matrices y/XA and y/XA and, in first ap¬ 
proximation, the distribution of the phase is repeatedly transformed by the 
transition matrix B upon each visit to the boundary. 

Lemma 7.2 The stationary distribution oftpx at epochs of regeneration con¬ 
verges as X — y oo to p with 

p = 7 /3(g(—A )- 1 + Q(U - U(q ))), (56) 

where (3 is the stationary probability vector of B and 

7=(/3(g(-A)- 1 -0t/(g))l)- 1 (57) 

is the normalization constant. 


Proof The transition matrix at epochs of regeneration is given by (19), 
where 


Pa,o — y/XA + ql — (l/y/~X)Q) 1 
= -)=,(-l )- 1 + 0(l/A) 


Pa i = 


y/X(-y/XA + ql- (1 /yfX)Q)~ 1 A 

B H— ^-=qA~ l B + 0(1/A). 
v A 


Taking the limit as A — > oo on both sides of (19), we find that the limit $ of 
satisfies the equation $ = P<h where B is stochastic. This shows that $ 
is of rank one, and that 

$ = 1 p (58) 

for some vector p. The matrix $ is stochastic, and so p is its stationary 
probability vector. Thus, 

<h A = 1 • p + -^=$' + 0(1/A) 
v A 


for some matrix and, by equating the coefficients of l/\/A on both sides 
of (19), we get 


$' = q(-A)- 1 + BQ(U - U(q )) + P<f>' + BQU(q) 1 ■ p + qA~ x B\ ■ p. 
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since B 1 = 1. We pre-multiply both sides by (3 and obtain 

0 = Ptqt-A)- 1 + Q(U - U(q ))) + {PQU(q)l + qpA~ l l)p 
from which (56, 57) follow. □ 

Lemma 7.3 In the limit as A —>■ oo, the expected time spent in [0,x] between 
regeneration points is 

M(x) = 7 1 • /3(—A -1 + 2(—K)~ 1 (I — e Kx )Q~ 1 ) (59) 

for x > 0, and 

m = 7 (f3{-A~ l + 2(-/l)- 1 0~ 1 )l) 1. (60) 

Proof We decompose M x (x) as in Lemmas 4.3 and 5.2: 

M x (x) = {-y/XA + ql- ~^QY l + P\,iM f ix) + P x ^ x (q)M x (x) 

= + ( B + ^g^ _1 M/(x)) 

+ (B + + l=QU(q))M x (x) + 0(1/X). 

In the limit, M x (x) converges to a solution of M(x) = BM(x), so that 

lim M x (x) — 1 ■ Jl(x) 

A—^oo 

for some vector jl(x) which needs to be determined. We proceed just like we 
did in the proof of Lemma 7.2, and obtain 

Ji(x) = 7/3 (A- 1 + 2- e^)©^ 1 ). 

The proof of (60) is immediate. □ 

Remark 7.4 We observe in (58) the effect of the Brownian motion jiggle 
at the boundary: by the time the exponential timer is off, the process will 
have hit level 0 so often that the phase at the next regeneration epoch will 
be independent of the phase at the last one. 

The same effect is at work in (59): after a regeneration point, the phase 
will be repeatedly re-sampled through the matrix B, so often that the ex¬ 
pected length of any interval between regeneration points is independent of 
the phase at the end of the previous interval, and depends only on the sta¬ 
tionary distribution of B. 

In short, we refer to the limit as a process with sticky boundary and 
resampling of the phase at level zero. 
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Theorem 7.5 The stationary probability distribution function of the process 
{Y(t),<p(t)} with sticky boundary and resampling of the phase at zero is given 
by 

G(x) = iPi-A- 1 + 2(-K)-\l - e Kx )Q~ l ) : (61) 

independently of q, where (3 is the stationary probability vector of B andj is 
given in (57). 

The marginal distribution of the phase is G(oo) = 7/3(— A~ l +2{— Ji) -1 © -1 ). 
Proof By Lemmas 7.2 and 7.3, 

G(x) = 7 f3{-qA~ l + G(U - U(q))) 7 I • (3{-A~ l + 2(-K)~\l - e**)©" 1 ) 

= 7/3(-2 _1 + 2(—K)~ 1 (I - e^)©" 1 ) 

after reorganization of some factors, and using the relation U1 = 0. □ 


8 Concluding remarks 

To the best of our knowledge, these are the first results on MMBMs where 
the evolution of the phase ip may depend on the level, with the exception of 
Chen et al. [6]: the authors consider MMBMs with level-dependent, piecewise 
constant, fluid rates and obtain the stationary distribution by numerically 
solving systems of partial differential equations. 

Our regenerative approach to the analysis of regulated MMBMs clearly 
shows great promise in allowing more complex assumptions than has been the 
case until now. We have demonstrated this on two specific cases of reactive 
boundaries in Sections 4 and 7 but other examples easily come to mind, as 
in Latouche and Nguyen [12], 

In each case covered here, the stationary distribution is easily calculated 
once the matrices U and U(q) are determined. Extremely efficient algo¬ 
rithms exist to solve the matrix equation (25), such as those in Latouche and 
Nguyen [14], and Nguyen and Poloni [15], and so the question of numerically 
obtaining these distributions is not an issue. 

There is a striking difference between the “traditional” process analyzed in 
Section 5 and the two processes with sticky boundary: the representation of 
the stationary distribution in Corollaries 6.1 and 6.2 hold in the first case but 
not in the other two. Instead, the importance of the distribution at epochs 
of regeneration is made more manifest, observe that the vector v in (38) and 
(3 in (61) are related in the same manner to the distribution at epochs of 
regeneration: (26) may be written as 

CiuA~ l = pM( 0) 
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and (56) as 

c 6 /3(-A) _1 = pM( 0) 

for some scalar Cq. In both equations, the ith component of the vector in the 
right-hand side is the expected time spent in phase i at level 0 between two 
regeneration points. 
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